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1 Adaptive resampling 


c 


• Converting a signal between two domains using incoherent sample clocks. 

* The resampling ratio is only know nominally and may drift over time. 

* It must be derived in an adaptive way from the actual signals. 

• Required for 

* Connecting installations that can’t share a common clock (quite common 
in broadcasting). 

* Adding an additional sound card as a Jack client. 

* Receiving audio signals from the network while using a local audio device. 

* An audio player slaved to timecode while the sample rate remains fixed. 
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2 Adaptive resampling 


c 


• A relatively simple problem in hardware 

* Sample clocks are available or can be extracted from the signal. 

* Apart from the resampler itself, only a relatively simple DLL is 
required to control the resampling ratio. 

* Some PRO hardware provides this on selected inputs. 

• In a software enviroment the problem is not the actual variable ratio 
resampling, but how to control it. 

* Signals are available in blocks of samples only. 

* Timing information is inaccurate and noisy. 
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3 Delay modulation 


c 


• A variable resampling ratio results in delay modulation. 

* Small, slow and smooth changes are equivalent to a listener moving 
w.r.t the speaker(s), or a sound source w.r.t. the microphone(s), and 
are harmless. 

* Larger variations may result in perceptible delay changes. 

* Faster variations may result in perceptible pitch changes. 

* Variations within the audio frequency range result in phase modulation 
with a modulation index proportional to the signal frequency. 

* The effect is the same as for jitter on a AD or DA converter sample 
clock. 
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4 


Phase modulation and noise 


c 



Original signal 



Resampled by zita-j2a 



Output via cheap MOBO device 



resampled by alsa_out 
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5 Requirements 


c 


• Jack client providing adaptive resampling for an ALSA device. 

* Multichannel. 

* CPU efficient. 

• Preserve audio quality of the additional soundcard. 

* Use only slow and very smooth adjustments of the resampling ratio. 

• Add minimal and at least stable and repeatable delay. 

• Fast recovery from incidents that disrupt normal timing. 

* Skipped cycles (Jackl). 

* Freewheeling. 

* Server timeouts due to misbehaving clients. 

* Xruns on the ALSA device. 
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6 Principle of operation 


c 


• If the resampling ratio is correct, then the delay will be constant. 

• There will be a constant number of samples, measured in either the input or 
output rate, ’in the pipeline’. 

• Find this number, compare to a target value and use the difference to control the 
resampling ratio. This is a feedback loop (DLL). 

• To obtain zero average delay error, there must be two integration steps the loop. 
The resampler acts as an integrator, so it we need just one more in the control 
logic. 

• Realistic values for the loop bandwidth are in the range 0.01... 0.10 Hz. 

• A practical realisation will consist of a variable size buffer and the resampler. 
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7 What does not work 


c 


1 

ALSA | Jack 

1 

1 

_1_ 



Variable length 


Resampler 



Buffer 




1 

1 

1 

1 

1 

1 



1 \At 

— 




• Observing the buffer state, and finding the average number of samples 
stored in it. 

• The timing of the vertical edges is irrelevant for the actual result. 

• Using it introduces errors that do not average out in the long term. 

• We can’t reliably observe the state of a lock-free queue anyway. 
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8 A solution - 1 


c 


(Again using A2J as the example) 

• If we could have two well-behaved functions A(t) and J(t) that represent 
the number of samples put into resp. read from the buffer, we could 
evaluate those at the start of each Jack period. 

• On the Jack side we can have J(tj) = kj — E&R, with tj the the 
start-of-cycle timestamp calculated by Jack’s DLL, and Ur the number 
of samples used or produced by the resampler in the previous cycle. Since 
we are only interested in the value at the start of a cycle, that’s all we 
need. 

• On the ALSA side we can do the same if we implement a DLL there as 
well, and transmit the result in a safe way (a lock-free queue) to Jack’s 
processQ. 
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9 A solution - 2 


c 


• On the Jack side this info is used to accumulate the number of sam¬ 
ples written by the ALSA side in with a corresponding timestamp 
t, 4 i. Using also the values from the previous cycle, Jgao and tAo we can 
interpolate to find A(tj). The difference A(tj) — J{tj) is the value we 
want. 

• Note that we don’t ever read the actual state of the lock-free audio buffer 
at all, we only use the accumulated values Jga and kj. 

• We need correct initial values for both of them. 

• We must also ensure that the abstraction — the two accumulators Jga 
and kj — stays in sync with the actual buffer. Any changes to either 
value (e.g. for error recovery) must be compensated by some logical read 
or write action on the actual buffer. We can only increment or decrement 
them, not ever assign a new value. 

• These and some other issues are discussed in more detail in the paper. 
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10 Resampler delay 


c 


outdist = 4.5 samples 



o o o o 


o o o 


- Output samples 

- Multiphase filter 

- Input samples 


• So far we looked only at the variable size buffer and ignored the delay in the 
resampling algorithm. 

• In each period it will take/put an integer number of samples from/into the buffer, 
but it stores a number of samples internally as well, and its state can also represent 
a fraction of a sample. 

• This value can be provided by the resampling library only. 
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11 Loop error equations 


c 


Let kj be the jack side sample count at tj , the start of the current 
period, kAo and kAi two sample counts at the ALSA side at times 
tAo and tAi, then the loop error becomes 


Ea2J I^ao kj\ “L c^a + d res A ( 1 ) 

Ej2A = [kj - k A o] - d A + d res * 7 - A (2) 

with 7 the current resampling ratio, A the target latency value, d res 
the current resampler delay, and 

d A = A(tj) = [k A i - kAo]* 1 — tj r~ ( 3 ) 

Ml — MO 

which is the ALSA side sample count interpolated at the start of the 
current Jack period. 
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12 Zita-ajbridge structure 


c 
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13 Results - residual phase variations 


c 



Measured phase (degrees) of a 1kHz sine wave resampled by zita-a2j, 48kHz to 44.1kHz 

X-axis in centiseconds. 
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14 Results - two devices competing for one CPU 


c 



Measured phase (degrees) of a 1kHz sine wave resampled by zita-a2j, 48kHz to 48kHz 

X-axis in centiseconds. 


Controlling Adaptive Resampling - 14 


Linux Audio Conference - 12... 15 April 2012 - CCRMA, Stanford CA, USA 


© 2012 F.Adriaensen 


















15 Q & A 


c 


The End 


Many thanks to CCRMA and the LAC team 
for making this presentation possible! 
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